Papers with monolingual teacher model
Multi-teacher Distillation for Multilingual Spelling Correction (2023.emnlp-industry)
Copied to clipboard
| Challenge: | a multilingual spelling correction model is needed to meet the tight latency requirements of multilingual NLP . a monolingual teacher model is trained for each language/locale, and individual models are distilled into a single student model . |
| Approach: | They propose a multilingual approach to spelling correction using multi-teacher distillation . they train a monolingual teacher model for each language and distill them into a single model . |
| Outcome: | The proposed model can meet the tight latency requirements of deployed services. |